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Abstract 

We study the behaviour of Tikhonov regularisation on topological 
spaces with multiple regularisation terms. The main result of the pa- 
per shows that multi-parameter regularisation is well-posed in the sense 
that the results depend continuously on the data and converge to a true 
solution of the equation to be solved as the noise level decreases to zero. 
Moreover, we derive convergence rates in terms of a generalised Bregman 
distance using the method of variational inequalities. All the results in 
the paper, including the convergence rates, consider not only noise in the 
data, but also errors in the operator. 



1 Introduction 

Classical Tikhonov regularisation for the approximate solution of an ill-posed 
operator equation F(x) = y on Hilbert spaces consists in the minimisation of 
the Tikhonov functional 

7» := \\F(x)-yf + a\\xf 

for some regularisation parameter a > depending on the noise level 121) . 
Here, the regularisation term ||x|| 2 encodes some qualitative a-priori knowledge 
about the true solution of the equation — in this case, it is assumed to have a 
small Hilbert space norm. In many applications, however, for instance in image 
processing, the a-priori knowledge has a different form than that of smallness 
of some Hilbert space norm. Therefore it is necessary to employ other kinds 
of regularisation terms (see |19j for an overview on regularisation methods in 
image processing), and one arrives at Tikhonov functionals of the form 

7» := \\F(x) - yf + a1l(x) 

with convex regularisation terms 1Z. The regularising properties of Tikhonov 
functionals of that form have for instance been studied in [2U] . 
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In this paper, we study two additional generalisations of Tiklionov regular- 
isation. First, we consider more general, non-quadratic, distance like measures 
for the similarity term instead of the of the squared norm of the residual. Typ- 
ical examples include f -divergences, which appear naturally when the noise is 
known to follow a distribution that is not Gaussian. An overview of useful 
similarity terms for Tikhonov regularisation can for instance be found in |18) . 
The second generalisation is concerned with the regularisation term. Instead of 
assuming that the a-priori information about the true solution can be encoded 
in a single functional, we study the situation where we have available different, 
possibly contradicting pieces of information, each of which can be described by 
the smallness of a different regularisation term IZk- Examples in image pro- 
cessing include the famous Mumford-Shah model, which assumes that images 
consist of different objects, characterised by smooth intensity variations and 
separated by pronounced edges [T7], but also models, which decompose images 
into geometric parts and texture [13 HI] (see also pQ for an overview) . Other 
examples, where multi-parameter Tikhonov regularisation has been proposed 
for the solution of inverse problems include [3J El 123] ■ In all these settings, 
regularisation is achieved by minimisation of a Tikhonov functional of the form 

T(x) :=S{F(x),y) + J2 a kn k (x) . (1) 

k 

From the theoretical point of view, multi-parameter Tikhonov regularisation 
is interesting, as it shares most of the features of single-parameter Tikhonov 
regularisation, but still exhibits some crucial differences, for instance concerning 
the formulation and interpretation of convergence rates. Still, it seems that no 
comprehensive study concerning the regularising properties of multi-parameter 
Tikhonov regularisation has been published. Most of the existing theoretical 
papers rather deal primarily with the problem of a suitable parameter choice (see 
for instance [131 HH H3 ) , but questions like stability and convergence have been 
neglected, in particular in the interesting case when the different regularisation 
parameters a k decrease to zero at different rates. 

In this paper, we will prove stability and convergence of multi-parameter 
regularisation under fairly general conditions. Because anyway no trace of an 
original Hilbert space or Banach space structure is left in the formulation of the 
Tikhonov functional 7" in ([1]), we will completely discard all assumption of a 
linear structure and instead consider the situation, where both the domain X 
and the co-domain Y of the operator F are mere topological spaces, with the 
topology of Y defined by the distance measure S. In this setting, we prove the 
continuous dependence of the minimiser x £ X of T on variations in the data 
y G Y and the regularisation vector a, as long as at least one component of a 
stays positive. In addition, we consider the case where also the operator F to be 
inverted is prone to errors. We introduce a suitable topology on the space of all 
operators from X to Y , which is related to the topology of uniform convergence 
on compact sets, and show that the minimisers of 7~ also depend continuously 
on the operator F. 

Then we turn to the study of the behaviour of the minimisers of T as the reg- 
ularisation vector and the noise level — both noise in the data and the operator — 
tend to zero. We prove the convergence of the regularised solutions to a solution 
of the exact equation provided the regularisation vector converges to zero suffi- 
ciently slowly. The relation between the noise level and the regularisation that 



2 



is required for deriving this kind of convergence is a natural generalisation of 
the usual condition required for the convergence of single-parameter Tikhonov 
regularisation. There is, however, a notable difference to the single-parameter 
case. While in the single-parameter case, the regularised solutions converge not 
to any solution of the equation F(x) = y, but rather to an 7^-minimising one, 
this behaviour cannot be guaranteed in the multi-parameter case, if the com- 
ponents of a decrease to zero at different rates and the regularisation terms IZk 
have different proper domains. 

Finally, we derive quantitative estimates for the difference between the reg- 
ularised solution of the equation and the true solution in dependence of the 
noise level, the regularisation parameter, and the accuracy of the operator. Be- 
cause we work in general topological spaces, we cannot employ the classical 
range or source conditions for the derivation of convergence rates. Instead, we 
make use of the method of variational inequalities introduced in [TO] and its 
modifications and generalisations used in [21 [TO] • Apart from the extension to 
multi-parameter regularisation, a major novelty of the quantitative estimate lies 
in the inclusion of operator errors, which previously have never been treated by 
means of variational inequalities. 

2 Preliminaries 

Assume that X and Y are sets and F: X — > Y some mapping. We consider 
multi-parameter Tikhonov regularisation with a regularisation functional of the 
form 

T(x; a, y, F) = S(F(x),y) + ^ a k K k (x) , (2) 

k 

where IZk '■ X — > [0, +00] are non- negative regularising terms and S: Y x Y ^ 
R>o is a distance like functional satisfying S(y, z) = if and only if y = z. Here 
we define a.k1Zk(x) := if at = and 1Zk{x) = +00. 

Single-parameter Tikhonov regularisation in such a general setting with non- 
metric distance measure has been considered in [9l [18] . See in particular [18] , 
where a large number of useful similarity measures is presented. In all these 
papers it was assumed that the target space Y is a topological space with a 
topology that is well compatible with both the function F to be inverted and 
the similarity measure S. In this paper, we follow the approach from |11) . 
where the well-posedness of the residual method has been treated, and use the 
similarity measure iS to define a topology on Y. 

First, we consider on the set Y the uniformity U that is induced by the 
family of pseudo- metrics S- z ^ :Fxf4 K>o, z G Y, defined by 

dWfo.SO : = \S(z,y) - S(z,y)\ . 

Moreover, we denote by a the topology induced by the uniformity U. Then a 
sequence {y^}ieN C Y converges to y £ Y with respect to a, if S(z,y^) —> 
S(z,y) for every z S Y. Note in particular that the condition S(z 7 y) = if 
and only if y = z implies that the topology a is Hausdorff, as the metric 
separates z from every other point y s Y \ {z}. 

Remark 2.1. Consider the special case where the functional S is of the form S = 
pod with d a metric on Y and p: K>o — > K>o continuous and strictly increasing 
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with p(0) = 0. Because for every z € Y the mapping y i-> S(z, y) = p(d(z, y)) is 
continuous with respect to the metric topology on Y, it follows that the metric 
topology is finer than a. Conversely, every metric ball 

B r (z) = {yeY: d{z,y) <r} = {yeY: S(z,y) < p-\r)} 

is open with respect to a, which shows that, in fact, the topology a coincides 
with the metric topology on Y. ■ 

Remark 2.2. In [IT] , a topology on Y has been defined by the single pseudo- 
metric 

d s ^(y,y) := sup d^(y,y) = sup\\S(z, y) - S{z,y)\ : z 6 y\ . (3) 

While this definition is reasonable in the case of the residual method, where 
we can assume that the functional S has a structure that is very similar to 
that of a distance, it is less so for Tikhonov regularisation, where we must 
rather assume that S resembles the power of a distance. Indeed, already in 
the classical Hilbcrt space setting with S(z,y) = \\z — y\\y the definition §5§ is 
useless, as d sup (y,y) = +oc whenever y ^ y. m 

In addition to the topology on Y, we require a suitable topology on the space 
X, which ensures the existence of a minimiser of the regularisation functional 
T(-; ct,y, F) for every positive regularisation parameter a € M> \ {0}, every 
y £ Y, and all mappings F that are compatible with the topologies on X and 
Y. The first assumption on the topology is a standard requirement for the 
subsequent application of the direct method in the calculus of variations. 

Assumption 2.3. There exists a topology t on X such that each mapping 
IZk ■ X — >■ [0, +oc] is sequentially coercive and lower semi-continuous with re- 
spect to T. | 

In addition, we have to ensure that the mapping F is well compatible with 
the topology r on X. More precisely, we require the lower semi-continuity of the 
mapping (x,y) i— > S(F(x),y). This condition alone, however, is not sufficient 
for obtaining stability when one of the regularisation parameters tends to zero 
(but not all of them do) . In order to treat this case as well, we have to introduce 
a density condition for the domains of the regularisation terms IZk with respect 
to a suitable type of convergence. 

We denote by 

V := {x e X : K k {x) < +oo for all 1 < k < n) 

the joint domain of the regularisation terms IZk- Throughout the paper, we as- 
sume that T> ^ 0; in the degenerate case T> = 0, multi-parameter regularisation 
with the regularisation terms IZk is not very useful, as, necessarily, some of the 
regularisation parameters ctk have to be zero. 

Definition 2.4. Let r be a topology on X. We denote by T(r) the set of all 
mappings F : X — » Y satisfying the following conditions: 

• The mapping (x,y) > S(F(x),y) is sequentially lower semi-continuous 
with respect to the product topology (t x a) on X x Y. 
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• For every x G X and every y G Y there exists a sequence {x^}z £ n C P 
converging to x with respect to t such that lZk(x^) —> ftfc(x) for every 
1 < k < n and S(F(xW), y) -> S(F(x), y). ■ 

Because we study also the stability of Tikhonov regularisation with respect 
to operator errors, we have to introduce in addition some notion of convergence 
of operators F: X — ► Y. To that end, we define for K C X and L C Y a 
pseudo-metric di^L on the set of all functions from X to Y by 

d KlL (F,G) :=sup{\S(F(x),z) -S(G(x),z)\ : x G K, z e L} . 

Definition 2.5. Let F^ : X — >• Y, I G N, be a sequence of mappings, let 
F: X — » Y, and let r be a topology on X. We say that the sequence {i 7 '")}; e N 
converges to F with respect to r, if 

d K , L (F^,F) ->0 

whenever if C I is sequentially r-compact and L C Y is sequentially er- 
compact. a 

Remark 2.6. Note that, according to Definition 12.51 a sequence of functions 
: X — > y convergence to i 7, : X — ?> Y with respect to r, if and only if the 
sequence of real valued functions (a;, y) M> S(F^ (x), y) converges to the function 
(x,y) i — ^ S(F(x),y) uniformly on sequentially compact sets. ■ 

The following implications of the convergence of functions introduced in 12.51 
will be required several times in this paper. 

Lemma 2.7. Assume that the sequence of functions {F^}i e fq C J~(t) con- 
verges to F G J~(t) with respect to r. Assume moreover that {x^^}; £ n C X 
converges to x G X with respect to r and {y"'}i0$ G Y converges to y G Y tuii/i 
respect to a. Then 

limS(F ( - l \x),y il) )^S(F(x),y) < liminf S(F^(x^), yW) . 

Proof. Consider the sequentially compact sets if := {x} U {x("}; £ n and L := 
{»}U{» (I) }iai. Then 

\S(FW(x),y®)-S(F(x),y)\ 

< \S(F«>{x),y®)-S(F(x),y®)\ + \S(F(x),yW) - S(F(x),y)\ 

< d x , L (F( l \F) + \S(F(x),yW) - S(F(x),y)\ . 

Now the convergence of the sequence {F^ to F implies that d x ,L (F^ , F) — > 
0. In addition, the convergence y"> — > y implies that S(F(x), y^) — > S(F(x),y). 
This shows that 

]imS(F^(x),y^)=S(F(x),y) . 

Moreover we have 

S(F^ l \x^),y^) = S(F(x^),y^) + S(F^(x^),y^) - S(F(x^),y^) 
>S(F(x^),y^)-d K , L (F {l \F) . 
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Thus the convergence of {jP^"}j£N to F and the fact that F £ F(t) imply that 

liuiMS(F il) (x^),y il) ) > limirf S{F(x il) ),y (l) ) ~ liyid K:L (F (l \ F) 

>S(F{x),y). □ 



3 Well-posedness 

In this section we study the well-posedness of multi-parameter Tikhonov reg- 
ularisation with the Tikhonov functional T given in @. First we prove the 
existence of a minimiser, and we show that the minimisers depend continuously 
on the data y £ Y, the regularisation parameter a £ K> , and the operator 
F: X — > Y. Then we prove the convergence of the minimisers to a solution 
of the equation F(x) = y as the noise level approaches zero, as long as the 
regularisation parameters ctk tend to zero sufficiently slowly. 



3.1 Existence and Stability 

Proposition 3.1. Let Assumption GO) be satisfied, let F £ F(t), y £ Y, and 
a £ M™q \ {0}. Then the Tikhonov functional T{-\ct,y, F) admits a minimum 
in X . 

Proof. This is a straightforward application of the direct method in the calculus 
of variations. □ 

The main difficulties in the proof of the stability of the regularisation method 
are due to the incorporation of operator errors, but also due to the fact that we 
do not exclude the situation, where some of the regularisation parameters ctk 
vanish (though we require that at least one of them stays positive). 

Proposition 3.2. Let Assumption \2.S\ be satisfied, let {y"'}ief$ C Y be any 
sequence converging to y s £ Y with respect to a , let {F^^i^ C J~{t) be any 
sequence converging to F s £ F(t), and let C K> \ {0} converge to 

a £ R£ \ {0}, and let 

x {l) £ argrmn{T(x;a (i) ,2/W,-FW) : x £ X) . 

Then the sequence has a sub-sequence that converges with respect to r 

to some 

x a £ argmin{T(a;; a, y , F S ) : x £ X) . 

Proof. Let x £ T> be arbitrary and let 1 < ko < n be such that ctk > 0. By the 
minimality of x^ we have 



4X(x«)<r(x«;a«,/),F«) 
<T(x;cP> )y ®,F®) 
= S(F^(x),y^)+J2^n(a 
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Because the sequence {a^j-jgN converges to a and a ko > 0, we may assume 
without loss of generality that af^ > for all I G N, and therefore also 
inf; ajj^ > 0. In addition, it follows that sup z aj^ < +oo for every k. Moreover, 

the convergence of the sequence {y^}i£N to y s implies that S(F"> (x),y"' ) ) — > 
S(F(x),y s ) < +oo (see Lemma 12771) . showing that sup l S(F^(x),y^) < +oo. 
Therefore 

X, MOW g(^ ( ' ) (^,2/ ( ' ) ) + S fc 4' ) ^(^) . , 
sup 7<.fe (x w 1 < sup ttt — - — - < +oo . 

The sequential r-coercivity of 7?.fc implies now the existence of a sub-sequence, 
for simplicity again denoted by {x^}z g N, converging with respect to t to some 

.t e x. 

It remains to show that T{xo;a,y s ,F s ) < T{x\ a,y s , F s ) for every x G X. 
To that end, note first that Lemma 12771 implies that 

S(F 5 (x ),y 5 ) < ]xca.w£S(F®(x®),yW) . 

Because the functionals IZf. are r-lower semi-continuous and a^ 1 ' — > a, it follows 
that also 

J2 a kn k (x ) < liminf afll k {x^) . 

k 

Thus 

T(x ;a,y 5 ,F s ) < liminf 7> (i) ; a (i) , y (z) , F^) . (4) 

Now assume that x G 2? is arbitrary. Then we obtain from Lemma 12.71 the 
equality 

S(F s (x),y s ) = limS(FW(x),yU) . 

Moreover, since 7Zk(x) < +oo for every k, it follows that 

(0 

k k 

Thus (|4]) and the minimality assumption of x^ imply that 

T(x ;a,y s ,F s ) < UmmiT{x^;a (l) ,y W ,F^) 
< limm£T(x;a^,y w ,F^) 



liminf \S(F^(x), y (l) ) + ^ a k l) TZ k (i 
S(F s (S:),y s )+J2akn k (i 

k 

T(x;a,y s ,F 5 ) 



k 

ix) 



(5) 



Now let x G X be arbitrary. Then there exists a sequence {x^}i e ^ converg- 
ing to x with respect to r such that x^ 1 ' G V for every i, lZk(x"') — > TZk(x) for 
every 1 < k < n, and S(F s (x®),y 5 ) -> y 5 ). Consequently © implies 

that 

r^o;^,^,^) < liminfT(5«;a,/ ) F 5 )=T(x;a,y 5 , J F 5 ), (6) 
showing that xq is indeed a minimiser of T(-; a,y s , F s ). □ 
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3.2 Convergence 

In standard Tikhonov regularisation, the usual condition guaranteeing conver- 
gence is the assumption S 2 /a — > 0. In the setting of multi-parameter regularisa- 
tion, this assumption obviously cannot be applied directly. One possible remedy 
are the assumptions 

mint, a k S(y,y s ) , . 

— > c > and yy,y ' -»• . 7 

max fe a k max fe a k 

These assumptions, however, imply that all the regularisation parameters con- 
verge to zero at the same speed, which does not seem reasonable. One of the 
main advantages of multi-parameter regularisation is precisely its flexibility in 
the parameter choice, which allows for different rates for the different compo- 
nents of the parameter vector. Instead of using (|7|). we therefore consider, in 
the case of an exact operator F, the weaker condition 

This condition allows the different parameters to decrease at different rates. 
Moreover, it makes sense, as one can interpret the denominator, a k , as the 
total amount of regularisation. 

Theorem 3.3. Let Assumvtion \2.S\ be satisfied, let F £ J~(t) and j/eY, and 
assume that there exists xq £ T> such that F(xq) = y. Let moreover {?/^};eN C 
Y be any sequence converging to y with respect to a, and {-F^lzgN C F(t) any 
sequence converging to F with respect to r. Let L := {y} U {y^}/eN an d 

K := {x 6 X : 1Z k (x) < 1Z k (xo) + 1 for some 1 < k < n] . 

Assume that 

S(y,yM)+d K , L (FU,F) ^ n 



E4^o ( 8) 



as I — > oo and let 

x {l) E argmin{T(a;;Q! W ,2/ w ,F w ) : x e X} . 
Consider any sub-sequence, again indexed by I, for which the vectors 

a® := € [0, If 

converge to some a 6 [0, 1]™ (such a sub-sequence exists because of the bounded- 
ness of the sequence). Then every sub-sequence of {cc^jjeN has a sub-sequence, 
for simplicity again denoted by {x^}i e n, t -converging to some x" 1 £ X satisfy- 
ing F(x') = y. In addition 

53 a k TZ k {x^) < inf {J] a k K k (x) :xeV, F{x) = . (9) 

k k 
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Proof. Because the functional lZ k are sequentially r-coercive, it follows that the 
set K is sequentially r-compact as the finite union of sequentially r-compact 
sets. Moreover, the definition of x"' implies that 

^4^ fe (^)<r(xW;aW,^),FW) 

k 

<T{x -M l \y {l \F^) 

= 5(^(x ),2/ (i) )+^4°7e fe (xo) 

k 

< S(F(x ),yW) + d K , L {F® ,F)+J2 a^H k (xo) . 

k 

Dividing by J2 k a k ^ anc ^ usm g © an d the facts that F(xq) — y and xq 6 T>, 
we see that 

limsup y~]or k l 'TZ k (x^) < limsup J~]ar k l '~R, k (xo) = a k TZ k (x ) < +00 . 
1 — 1 

k k k 

Thus also 

limrap^fifcftfcfcW) < limsup^ 4° K k (x (l) ) < Y^a k K k (x ) . (10) 
In particular, for I sufficiently large, 

J2a k Tik(x (l) ) <J2^kn k (x) + 1 = J2^k(n k (x) + 1) , 

which in turn proves that the sequence {x^'}j g N is eventually contained in the 
sequentially r-compact set K . Thus, there exists a sub-sequence, for simplicity 
again denoted by converging with respect to r to some x^ G K. 

Now note that Lemma 1^71 and the facts that x^ — > x\ j/W -> y } iKQ — >. F, 
and J2 k 4 ' imply that 

t S(F(a; t ),y) < liminf 5(F (,) (a: w ),|/ (,) ) 

< IiminfT(a:W;a w ,y w ,ifW) 

< liminf T(x ;a {l \y {l \F^) 

< liminf (^(y, yW) + (Ik,l(F^\ F) + £ af^^o)) 

fe 

= 0, 

showing that <S(.F(a;T), y) = and hence -F(ar) = y. Moreover, the r-lower semi- 
continuity of the functions lZ k and the fact that (fTUj) holds for every x €T>f)K 
satisfying F(x) — y now imply that 

Y^a k n k {x^) < liminf 2 a k K k {x «) < liminf ^ 4° ^fc(x (z) ) 

< inf a k K k {x) :xeV(lK, F(x) = y} . (11) 
fe 

Now the definition of K implies that also ([§]) holds, which concludes the proof.D 
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Note that there is a crucial difference between the convergence result of The- 
orem 13.31 and the convergence results that can be derived for single-parameter 
regularisation. There, using conditions analogous to those of Theorem 13.31 one 
can show that the limit x* is an 7^-minimising solution of the equation F(x) = y. 
The corresponding result for multi-parameter regularisation would be that X s 
is a ckkR-k minimising solution of the equation F(x) = y, that is, 

X s G arg min|y^ a k 1Z k (x) ■ x G X, F(x) = y\ . 
fc 

This assertion, however, need not be true in the case where one of the limiting 
regularisation parameters oik vanishes, but the approaching weighted parameters 
atf are all positive. 



4 Convergence Rates 

For the derivation of convergence rates, or, rather, quantitative estimates for the 
distance between regularised and true solution, we apply the method of varia- 
tional inequalities, which has been introduced in [T^] (see also [H]) and further 
developed in [21 [HI HQ] ■ In a Banach space setting with convex regularisation 
terms, estimates have been classically derived with respect to the Bregman dis- 
tance, which measures the distance between the regularisation term TZ k and its 
affine approximation at the true solution x^ (see [S]). Here we consider the set- 
ting introduced in [TU] (see also [TT]) and assume that a variational inequality 
is satisfied with respect to any distance like functional, which at the same time 
serves as the distance with respect to which the convergence rates are derived. 

Assumption 4.1. The element x* G T> satisfies F(x') = y, and for every 
1 < k < n there exists a function D k (-;x <! ): X — > IR>o satisfying D k (x^ ; X' ) = 
and a concave and strictly increasing function R>o — > K>o with < &fc(0) = 
such that 

D k {x-x^) <K k (x)-1l k (x1) + $ k (S(F(x),y)) (12) 
for every x G X. ■ 

In addition to the variational inequalities (|12[) . we assume in this section 
that the functional S satisfies a quasi-triangle inequality of the form 

S(z u z 2 ) < s(«S(zi,z 3 ) +S(z 3 ,z 2 )) (13) 

for some s > 1 and every z\, z<x, z 3 G Y. While such a quasi-triangle inequality 
is satisfied in the important case where the distance measure <S is the power of 
some metric on Y, it need not hold for instance in the case where S is some 
Bregman distance. 

Theorem 4.2. Let Assumption \4-. 1\ be satisfied and assume that S satisfies the 
quasi-triangle inequality (|13p . Define the function 'J : ]R™ — ¥ ]R>o, 

*(a) := sup(V s 2 a k ^ k (t) - t) , 
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and let 

K := {x £ X : TZ k {x) < TZ^) + 1 for some 1 < k < n } . 
Let y 5 G Y and F s £ F{t) and 

x s a e argmin{T(x; a, y 5 , F s ) : x 6 X) . 

Then the inequality 

a k D k (x s a ;xl) < sd K , y (F s , F) + (s + l)S(y, y s ) + ±S(y 5 , y) + ^ 

fc 

holds for dK, y (F s , F) and S(y,y s ) sufficiently small. In particular 

Dj{x s . x u < s 3 d K ^ y (F s , F) + (s 3 + 3 )S(y, y s ) + sSjy 6 , y) + tt(a) 

s 2 a 3 

for every 1 < j < n and every a 6 R™ with ctj > 0. 

Proof. Because x s a is a minimiser of T(-;a,y s , F s ), the inequality 

5(^(4),y A ") + ^a fc 7e fc (xi) < S(F S (x^),y s ) + J2^ k n k (x^ (15) 

fe fc 

holds. Moreover the quasi-triangle inequality (fT5)l and the fact that F(a^) = y 
and hence iS(F(a:^), j/) — imply that 

^(FV),^) < s(S(F s (x^),y) +S(y,y 6 )) < s(d K , y (F 5 , F) + S(y,y 5 )) 

and 

S(F(x s a ),y s ) < s(S(F(x s a ),y) + S(y, y 5 )) . 
Combining these inequalities with (1151) . we obtain 

S(F(x s a ),y 5 ) + s £ ak{n k {x s a ) - K k {x^)) < s 2 d K , v (F s ,F) + (s 2 + s)S(y, y s ) . 

k 

Using the reverse triangle inequality 

S(F(x s a ),y s )>~S(F(xi),y)-S(y s ,y) 
and the variational inequality (I12D . we arrive at the estimate 

-S(F(x 5 a ),y) - a £ a k $ k {S(F(x s a ), y)) + s£ * k D k (x s a ; x*) 

S k k 

< s 2 d K , y (F s , F) + (s 2 + s)S(y, y s ) + S(y s , y) 

Because, by definition of 

S(F(x s a ), y)~s 2 Y, {S(F(x s a ), y)) > -*(a) , 

k 

we obtain 

]Ta fcJ D fc (4;^) < sd Kty (F 5 ,F) + (s + l)S(y,y s ) + -S(y s ,y) + ^ . 
k s s 

Moreover, (fT¥|) holds, because every Bregman distance is non-negative and 
so are the regularisation parameters ctj . □ 
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Remark 4-3. If one wants to obtain the best possible rate for one specific Breg- 
man distance Di(-;xt) with the help of (TPR . then one should set all regular- 
isation parameters with i ^ j to zero. Indeed, the right hand side of (|14[) 
depends on a, with i ^ j only through "P, which is a monotonically increasing 
function. ■ 

5 Conclusion 

In this paper, we have shown that multi-parameter Tikhonov regularisation is 
a well-posed regularisation method in the sense of Tikhonov in a fairly general 
setting on topological spaces with lower semi-continuous and coercive regulari- 
sation terms and general distance like measures as similarity term. In addition 
to proving stability of the regularisation method with respect to noise in the 
data and varying regularisation parameters, we have also derived the continuous 
dependence of the regularised solutions on the operator F: X — > Y. To that 
end, we have introduced a topology on the space of mappings from X to Y that 
is compatible with the distance measure S on Y serving as a similarity term. In 
the classical setting of bounded linear operators between Banach spaces and the 
squared norm of the residual as a similarity measure, a sequence of bounded lin- 
ear mappings converges with respect to this topology, if and only if it converges 
with respect to the norm on L(X, Y). 

In addition, we have shown the convergence of the regularised solutions to 
a true solution, if the regularisation vector decreases to zero slowly enough in 
dependence of the noise level of the data and the operator error. Extrapolat- 
ing the results from single-parameter regularisation, one would expect that the 
limit of the regularised solutions minimises, over the set of all solutions of the 
equation F(x) — y, a certain convex combination ^2 k a^R-k of the regularisation 
terms. It seems, however, that this need not be the case if the different compo- 
nents of the regularisation vector converge to zero at different rates. Then one 
only obtains that 

^ak1Zk(x^) < ^a k TZ k (x) 

k k 

for every x £ X satisfying F(x) = y and 1Zk{x) < +00 for every k. If one 
of the coefficients a k equals zero, say afc = this result says nothing about 
the behaviour of J2k ^kR-k on solutions x of the equation F{x) — y satisfying 
TL ko (x) = +00. 

Finally, we have derived a quantitative estimate for the difference between 
the regularised solution and the true solution x' under the assumption that a 
variational inequality at the solution is satisfied. Similarly as the stability 
and convergence result, also this estimate takes into account the effect of opera- 
tor errors. Also in the case of the quantitative estimates, the difference between 
multi-parameter regularisation and single-parameter regularisation becomes rel- 
evant, as the estimates in the multi-parameter setting cannot be directly trans- 
lated into optimal convergence rates, as it is not clear, with respect to which 
distance this optimality should be measured. 
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